Multimodal Segmentation on a Large Interactive Tabletop:
نویسندگان
چکیده
Eye tracking is a promising input modality for interactive tabletops. However, issues such as eyelid occlusion and the viewing angle at distant positions present significant challenges for remote gaze tracking in this setting. We present the results of two studies that explore the way gaze interaction can be enabled. Our first study contributes the results from an empirical investigation of gaze accuracy on a large horizontal surface, finding gaze to be unusable close to the user (due to eyelid occlusion), accurate at arm’s length, and only precise horizontally at large distances. In consideration of these results, we propose two solutions for the design of interactive systems that utilise remote gaze-tracking on the tabletop; multimodal segmentation and the use of X-Gaze—our novel technique—to interact with out-of-reach objects. Our second study evaluates and validates both these solutions in a Videoon-Demand application, presenting immediate opportunities for remote-gaze interaction on horizontal surfaces.
منابع مشابه
Analyzing Multimodal Communication around a Shared Tabletop Display
Communication between people is inherently multimodal. People employ speech, facial expressions, eye gaze, and gesture, among other facilities, to support communication and cooperative activity. Complexity of communication increases when a person is without a modality such as hearing, often resulting in dependence on another person or an assistive device to facilitate communication. This paper ...
متن کاملA Framework for Bimanual Inter-Device Interactions
A shared interactive display (e.g., a tabletop) provides a large space for collaborative interactions. However, a public display lacks a private space for accessing sensitive information. On the other hand, a mobile device offers a private display and a variety of modalities for personal applications, but it is limited by a small screen. We have developed a framework that supports fluid and sea...
متن کاملSetting the stage for embodied activity: scientific discussion around a multitouch tabletop display
Multitouch tabletop displays are a promising technology for supporting small group discussion and learning activities. Based on a view of human activity as multimodal, distributed, and embodied, we examine the pedagogical affordances of interactive tabletop technology, how it supports small group scientific discussion, and compare it with use of traditional paper-based study materials. We analy...
متن کاملInteractive Segmentation in Multimodal Medical Imagery using a Bayesian Transductive Learning Approach
Labeled training data in the medical domain is rare and expensive to obtain. The lack of labeled multimodal medical image data is a major obstacle for devising learning-based interactive segmentation tools. Transductive learning (TL) or semi-supervised learning (SSL) offers a workaround by leveraging unlabeled and labeled data to infer labels for the test set given a small portion of label info...
متن کاملEnhancing Data-Driven Collaboration with Large-Scale Interactive Tabletops
Reality-based interfaces (RBIs) such as tabletop and tangible user interfaces offer unique opportunities for enhancing data-driven collaboration. In this paper, we describe the design and implementation of a large-scale interactive tabletop for augmenting data-driven colocated meetings of larger teams (8-12 participants). We also discuss usability challenges for large-scale tabletop interaction...
متن کامل